OPTIMAL INVESTMENT STRATEGY TO MINIMIZE OCCUPATION TIME 
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ERHAN BAYRAKTAR AND VIRGINIA R. YOUNG 

Abstract. We find the optimal investment strategy to minimize the expected time that an in- 
dividual's wealth stays below zero, the so-called occupation time. The individual consumes at a 
constant rate and invests in a Black-Scholes financial market consisting of one riskless and one 
risky asset, with the risky asset's price process following a geometric Brownian motion. We also 
consider an extension of this problem by penalizing the occupation time for the degree to which 
wealth is negative. 
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We find the optimal investment strategy to minimize the expected time that an individual's 
wealth remains negative during that person's life. The time t he wealth proce s s spend s below 
a given level (0 , in th is pa per) is known as the occupation time. Akahori ( 1995 ). Takacsl ( 1996 ). 
Doney and Yorl (119981). andlPechtl (119991) find the d i stribu tion of the occupation time for Brownian 



Linetsky (1999) and Hugonnierl (1999) derive pricing formulas of various types 



motion with drift. 

of derivatives based on the occupation time. To our knowledge, ours is the first study in controlling 
the occupation time. 

We were motivated to study this problem in order to give individuals advice for investing after 
they become bankrupt. One way to do this is to set an arbitrarily (large) negative ruin level 
and apply the investraent str ategy given by minimizing the probability of hitting that ruin level. 
Bayraktar and Young (120071 ) show that the optimal investment strategy is independent of the 
ruin level. Moreover, they show that if an individual were to minimize the expectation of a 
non-increasing function of minimum wealth, of which probability of ruin is an example, then the 
optimal investment strategy is independent of that function of wealth. 

Another way to address the problem of how to invest when wealth is negative is to minimize 
the expected occupation time below zero during one's life. When minimizing the probability 
of lifetime ruin, the "game" ends as soon as ruin occurs. However, even after ruin occurs, the 
individual is still alive and requires an investment strategy. In this paper, we consider the problem 
of minimizing the expected length of time that one's wealth is negative. 



Key words and phrases. Occupation time, optimal investment, stochastic control, free-boundary problem. 
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Our objective is to give investment advice to retirees. This is driven by the fact that retired 
Americans have an ever increasing risk of having their hving expenses exceed their financial re- 
sources. This risk is due to the increasing longevity of individuals and inadequate retirement 
savings. Moreover, individuals have to shoulder more financial risk now because of the continuing 
shift in pension plans towards defined contribution. To determine an investment policy, the indi- 
vidual needs to select an optimization criterion. The most common approach is to choose a utility 
function and determine a policy that maximizes ones expected discounted utility of consumption 
and bequest. However, when maximizing lifetime utility of consumption and bequest under the 
commonly used utility functions, the optimal investment strategy does not depend on the hazard 
rate. In giving investment advice to retirees, one expects that the advice should depend on the 
likelihood of dying (and she should be more conservative if this likelihood is higher), and our 
optimization criterion leads to such advice. Also, maximizing utility is arguably subjective, while 
minimizing the probability of lifetime ruin or minimizing the expected occupation time might 
prove easier for retirees to understand. 

The layout of the paper is as follows. In Section O we present and solve the problem of 
minimizing expected occupation time. In Section 12.11 we present the financial market in which 
the individual can invest, and we formulate the problem of minimizing expected occupation time. 
In Section 12.21 we provide a verification theorem for the minimum expected occupation time, 
which we use to obtain the value function in Section 12.31 via a related free-boundary problem. In 
Section [3l we present properties of the minimum occupation time and the corresponding optimal 
investment strategy. In Section HI we discuss an extension of minimizing expected occupation 
time. 

2. Minimizing Expected Occupation Time 

In Section [2TT| we describe the financial market in which the individual can invest her wealth, and 
we formulate the problem of minimizing expected occupation time. We also provide a verification 
theorem for the expected occupation time in Section 12. 2t then, in Section 12.31 we construct the 
minimum expected occupation time as the convex dual of a solution of a related free-boundary 
problem. 

2.1. Financial model. We consider an individual aged with future lifetime described by the 
random variable r^. Suppose is an exponential random variable with parameter A, also referred 
to as the hazard rate; in particular, E(rd) = 1/A. 

We assume that the individual consumes wealth at a constant net rate of c; this rate might 
be given in real or nominal units. We say that the rate c is a net rate because it is the rate 
of consumption offset by any income. One can interpret c as the minimum net consumption 
level below which the individual cannot (or will not) reduce her consumption further; therefore. 
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the minimum expected occupation time that we compute gives a lower bound for the expected 
occupation time under any consumption function bounded below by c. 

The individual can invest in a riskless asset, which earns interest at the rate r > 0. Also, she 
can invest in a risky asset whose price satisfies 

(2.1) dSt = fxStdt + aStdBt, Sq^ S>0, 

in which /i > r, a > 0, and S is a standard Brownian motion with respect to a filtration 
F = {J^t}t>o of a probability space (Q, ^, P). We assume that B is independent of r^, the random 
time of death of the individual. If c is given as a real rate of consumption (that is, after inflation), 
then we also express r and /i as real rates. 

Let TTt denote the amount invested in the risky asset at time t, and let tt denote the investment 
strategy {nt}t>o- We say that a strategy tt is admissible if the process n is adapted to the filtration 
F and if tt satisfies the condition tt^ ds < oo, almost surely, for all t > 0. The wealth dynamics 
of the individual for a given admissible strategy tt are given by 

(2.2) dWt = {rWt + {n- r)7rt - c)dt + antdBt, Wq^w>0. 

By lifetime occupation time, we mean the length of time that the individual's wealth is negative, 
before she dies. One could also consider the time that wealth is below some arbitrary level, 
not necessarily 0, but for ease of presentation, we choose the level to be 0. Define the process 
^ = {^t}t>o by 

(2.3) At^Ao+ [ l{w.<o}ds, Aq = a > 0. 

Jo 

Thus, we wish to minimize E"''" (A^-^), in which E™'" denotes expectation conditional on Wq — w 
and Aq — a. By allowing Aq to be non-zero, we allow the individual to have been in bankruptcy 
for a period of time prior to the beginning of the game. 

There is a problem with the goal of minimizing E"''" (A^J. Indeed, < E^'« (A^J < a + E(Td) = 
a + 1/A, and we expect the minimum E"''" {At^) to be a convex, non- increasing function of initial 
wealth w. However, there is no bounded, convex, non- increasing function defined on the reals, 
other than a constant function. Therefore, we modify the problem as follows: Define the minimum 
wealth process Z — {Zt}t>o by 

(2.4) Zt = min Ws. 

For L > 0, define the hitting time tl = inf{t > Q : Wt < —L}, and define the value function Ml 

by 

(2.5) ML(«;,a) = infE"''" 

TT 

Here, we take the infimum over admissible investment strategies. 
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For large values of L > 0, the control problem associated with approximates the problem 
of minimizing lifetime occupation time. Indeed, if lifetime wealth stays above — L, which is quite 
likely for L large, then the payoff is the occupation time. If wealth falls below — L, then we suppose 
that the individual will have negative wealth for the rest of her life, and we end the game, with 
payoff equal to the occupation time up to the hitting time tl plus E(rd) = 1/A. 

Note that for w < —L, Ml{w, a) = a + 1/X, and for w > c/r, Ml{w, a) = a. The latter holds 
because if w > c/r, then the individual can place all her wealth in the riskless asset and wealth 
will never go below w > c/r, much less reach 0. Therefore, it remains for us to determine Ml on 
(— L, c/r). The verification theorem in the next section will help us with that goal. 

2.2. Verification tiieorem for M^. 

Tlieorem 2.1. Suppose m : M — M a bounded, continuous function that satisfies the following 
conditions: 

(i) m is convex on {~L,c/r) and lies in C'^{{~L,c/r)), except at 0; 

(ii) m G C\M.y, 

(Hi) m{w) = 1/A for all w < —L; 

(iv) m{w) = for w > c/r; 

(v) m solves the following Hamilton- Jacobi- Bellman {HJB) equation on {—L,c/r) : 

(2.6) Xm{w) = l{u;<o} + i^u) — c)m'{w) + min (yU — r)Txra'{w) + -o'^ix'^m" {w) 

TT 2 

Then, the value function on M defined by (\2.5^ is given by 

(2.7) ML{w,a) = m{w) + a, 

and the optimal investment strategy vr* on {—L,c/r) is given in feedback form by 
in which W* is the optimally controlled wealth. 

Proof. Assume that m satisfies the conditions specified in the statement of this theorem. Let 
denote a Poisson process with rate A that is independent of the standard Brownian motion B 
driving the wealth process. The occurrence of a jump in the Poisson process represents the death 
of the individual. 

Let vr : R ^ R be a function, and let W^, , and Z'^ denote the wealth, occupation time, 
and minimum wealth, respectively, when the individual follows the investment policy vrt = TT{Wt). 
Assume that this investment policy is admissible. 

Define R = RU{cxd} to be the one-point compactification of R. The point oo is the "coffin 
state." The wealth process is killed (and sent to the coffin) as soon as the Poisson process jumps 
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(that is, when the individual dies), and we assign W^^ = oo; recall that is the random time of 
death. Given a function g on R, we extend it to M by g{oo) = 0. 

Define the stopping time r = A Tc/r Atl, in which Tc/r = mf{t > : Wt > c/r}; recall that 
Tl = inf {t >0:Wt< -L}. Also, define r„ = inf {t > : tt^ ds>n}. 

If Wo = w > c/r, then the individual can invest her wealth in the riskless asset and finance 
the cost of her consumption, which is no greater than ce~'^^dt = c/r. Therefore, with this 
strategy, her wealth will be at least c/r at the time of her death. In other words, if Wo = w > c/r, 
then Zt-j > c/r, which implies that Mi{w,a) = a for w > c/r. Similarly, if Wo = w < —L, then 
< —L, which implies that Ml{w, a) = a + 1/ X for w < — L. From these observations it follows 

that 



(2.9) ML{w,a) = miE'"''' 



ME" 



At + jl{Zr<-L} 



By applying a geri e ralize d Ito's formula for convex functions (see Theorem 6.22, page 214 of 
Karatzas and Shrevd (Il99ll )) to m{w) + a for w G {—L, c/r) and a > 0, we have 



(2.10) 

tAt„ 

ptArATn pIAtAt, 

= m{w) + a + / dAs + / 

Jo Jo 

-A / m{W^)ds+ / m'{W^)ansdB, 
Jo Jo 



rW^ + r)7is - c) m'(iy;) + ^a^ vr^ m"{W^) ] ds 



tArATn 



m{W^)d{Ns~ Xs). 



Here, we used the fact if the Poisson processes jumps at time s the change in the value of the 
process m{W^) + at time s is m{Wg) —m{Wg__) = ~m{Wg_) , in which the last equality follows 
since m(oo) = 0. In the derivation of (12.101) we also used the fact that m(W^_)ds = m{W^)ds 
which follows thanks to the fact that the Lebesgue measure is diffuse. 

It follows from the definition of A in (12. 3p that dAg = l{w<o} ds. The definition of r„ implies 
that the expectation of the fourth integral is 0. Moreover, the expectation of the fifth integral is 
zero since m is bounded; see, for example, iBremaudI (1l98ll ). 

Thus, we have 



E-''^ [m {W,l,,J + A^,,,,J = m{w) + a-E 

"tArATn 



tArArn 



Uo 



+ E 

Uo 

(2.11) >m{w) + a. 



Xm{W^)ds 
1 



Mw^<o} + {rW: + (/i - r)7r, - c) m'{W:) + -a' m"{W:) ) ds 



6 



ERHAN BAYRAKTAR AND VIRGINIA R. YOUNG 



in which the inequahty follows from assumption (v) of the theorem. Because m is bounded and 
because At < a + Td almost surely, it follows from the dominated convergence theorem that 



(2.12) 



E-'-^ [m{Wt\,) + A^^,] > m{w) + a. 



Inequality (12.121) shows that {fn{W^/^^) + ^7Ar}t>o ^ sub-martingale for any admissible strategy 

TT. 

^Prom m{c/r) = = m{W^J and m{—L) = 1/A, it follows that 

m{Wn + Al = {m {W:j + A^) + (m(c/r) + A^^^) 

+ H-^)+^^Jl{..<(..A../.)} 



(2.13) 



By taking the expectation of both sides of (12.131) . we obtain 



(2.14) 



E"'''^ [m{W^) + A^] > m{w) + a. 



The inequality in (12.141) follows from an application of the optional sampling theorem because 
{m{W^^^) + A^^^}t>o is a sub-martingale and sup^^n E"''°[m(W 7 I-^) + A I"^^] < oo; see Theorem 3.15, 
page 17 and Theorem 3.22, page 19 of iKaratzas and Shrevd (119911 ). By taking the infimum in 
(I2.14P over all admissible investment strategies, we obtain 



(2.15) 



infE"'''^ 



> m{w) + a. 



Now, by (12. 9p . the left-hand side of (12.151) equals Ml{w, a); thus, Ml{w, a) > m{w) + a. 

If the individual investor follows a strategy vr* that minimizes the right-hand side of (12.60 , then 
(12. lip is satisfied with equahty, and applying the dominated convergence theorem yields 



(2.16) 



E-'-[m{Wtt) + Af,^] = m{w) + A, 



which implies that {m(W^^^) + A^^^}t>o is a martingale. By following the same line of argument 
as above, we obtain 



(2.17) 



Ml(w, a) = miw) + a. 



which demonstrates that (12.70 holds and that vr* in (12.80 is an optimal investment strategy for 
wealth lying in (— L, c/r). □ 
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2.3. A related free-boundary problem. Next, we introduce a free-boundary problem (FBP) 
whose concave solution is the dual, via the Legendre transform, of ML{w,a) — a. In the first 
subsection, we solve the FBP, and in the subsection following, we show that the convex dual of 
the solution of the FBP, indeed, equals Ml{w, a) — a. 

Consider the following free-boundary problem (FBP) on [O,?/^]: 

Xm{y) = {X-r)ym'{y) + 6y'^m''{y) + cy + l{y>y^} on C=(0,?/l), 
(2.18) <J m(0) = and m'{yo) = 0, 

m{yL) = l/X - Lyi and m'(?/L) = -L, 

in which < yo < yL are the free boundaries and 5 = ^ (^V")^- 

2.3.1. Solving the FPB fl2.18p . To solve the FBP in fl2.18p . we consider the problem on the two 
domains: (1) < ?/ < ?/0) aiid (2) y^ < y < y^. After solving the FBP on each domain separately, 
we will impose value matching at y = yo to determine yo- 
First, consider < y < yo. On this domain, m solves 



(2.19) 



A rh{y) = (A — r) ym'{y) + 6y'^ rh"{y) + cy, 
m(0) = and m'{yo) = 0. 

The general solution of the ODE in fl2.19p is of the form 



(2.20) 



m{y) 



D,y''^+D2y^' + -y, 
r 



B2 



in which Di and D2 are constants to be determined, and Bi and B2 are given by 

1 



(2.21) 
and 
(2.22) 



^ 26 



X + 5) + v/(r - A + Sy + ASX 



(r - A + 5) - V(r - A + (5)2 + 4(5A 



> 1, 



< 0. 



The boundary condition at ?/ = implies that D2 = 0. The boundary condition at y = y^ 
implies that 



(2.23) = m'{yo) = D,B^y^^-' + -, 

which gives us a relationship between Di and yo, specifically, 

(2-24) ^' = -^/'~''^- 

We have, therefore, shown that on [0,?/o]) ^ is given by 



(2.25) 



m{y) 



1 



Bi \yo 



y 



Bi-l 
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Next, consider yo < y < Vl- On this domain, m solves 

Xrh{y) = (A — r) ym'{y) + 5y'^ m"{y) + + 1, 
m{yL) = l/\-LyL, rh'{yL) = -L, and rh'{yo) = 0. 

The general solution of the ODE in (12.26^ is of the form 



(2.26) 



(2.27) 



1 



m{y) = diy""' + d2y''' + -y + -, 

r A 



in which di and d2 are constants to be determined, and Bi and B2 are given by (12.211) and (I2.22p . 
respectively. 

The boundary conditions at y = yi imply that 



(2.28) 

and 

(2.29) 



1 c 1 

- - LyL = m{yL) = di y^' + d2 ' + -yL+ y 



L = m'{yL) = rfi B, + d2 B2 y^'^ + 



Solve these equations for di and ^2 in terms of y^ to obtain 

1 - B2 /c 



(2.30) 
and 
(2.31) 



do 



Bi — B2 



Vl 



Bi-l 1-B2 
Vl 



+ L 



+ L 



B1-B2 " vr 

Substitute these expressions for di and d2 into (I2.27P to obtain, for y^ < y < yi, 



(2.32) m{y) = y 



C 1 - fC 

r Bi — B2 Vr 



L 



y_ 

yL 



For later reference, we also have 
(2.33) miy) = -- _ 



- + L] 

yi 



Bi-1 
Bi — B2 



{Bl - l)B; 



L 



y_ 

yL 



B2-1 



1 

A' 



Bi — B2 



y_ 

yL 



B2-1 



The boundary condition at y = yo, namely m'(?/o) = 0, gives us the following equation for the 
ratio yo/yL e (0, 1): 



(2.34) 



c ^ Bi{l-B2 
c + rL~ B1-B2 



Bi-l 



Vl ^ 



{Bi - 1)B2 



yL 



-B2-1 



Bi — B2 

To see that (12.341) has a unique solution yo/yL in (0, 1), note that (a) as yo/yL approaches 0, the 
right-hand side of this equation approaches —00; (b) when yo/yL = 1, the right-hand side equals 
1 > c/(c + rL); and (c) the right-hand side is strictly increasing with respect to yo/yL- 
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Finally, given yo/yi, we can obtain i/q from m{yQ 
(2.35) 



c Bi 



r Bi 
or equivalently, 



(2.36) yo = j 



Bo 



B^-B2 \r 



+ L 



m 



Bi-l 



1 c ^ 1 



Bo 



Bir Bi- B2 



Vl 



Bi-l 



Bi-1 
B1-B2 \r 



+ L 



m 

Vl 



+ 



B^-B2 \r 



Vl 



Thus, we have proved the following proposition: 



Proposition 2.1. The solution m of the free- boundary problem in f l2.18p is given by 
(2.37) 



m{y) 



1-B2 (c , T\ I y_ 



Bi-1 

B1-B2 



i- + L) 

\r ' \yL 



B2-1 



0<y <yo; 



+ X' yo<y< yL- 



The free boundaries < yo < yi are given by solving (12.341) for yo/yi & (0, 1), then by obtaining 
7/0 from (I2.36P and y^ from the relationship y^ = yo/ iyolyL) ■ 

Note that the solution m of the FBP is bounded above by ul and that the two curves are 
tangent at y = and y = yi, in which ul is given by 



(2.38) 



udy) = min {^y, j- Ly] . 



We will use this observation when we consider the limit as L ^ 00. 

The following lemma shows that rh is concave, a property we use in the next section. 

Lemma 2.1. The solution rh of the FBP in (12.181) is concave on [0,?/^]. 

Proof. On [0,7/0)5 is given by (I2.25p . with first derivative m'{y) = (c/r) [l — {y/yo)^^~^] > 
and second derivative m"{y) = —{c/r){Bi — l)y^^~'^ / y^^'^ < 0. On {yo,yL], ^ is given by (I2.32p . 
One can show that the first derivative of rh is negative by using the fact that the right-hand side 
of (I2.34P is strictly increasing with respect to yo/yh- Also, the second derivative 



(2.39) 



rh"{y) 



1 (i?i-l)(l-52) fc_^^ 



Vl 



Bi — B2 



Vl 



Bi-2 



52 I ^ 

Vl 



B2-2 



< 0. 



Finally, m'(yo) = 0; thus, we have shown that rh is concave on [0,?/l]. 



□ 



In the next section, we show that rh is intimately connected with the minimum occupation time 
Ml. 
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2.3.2. Relation between the FBP i\2.18\) and the minimum occupation t ime. In this section, we show 
that the Legendre transform (see, for example, iKaratzas and Shrevd (119981 )) of the solution of the 
FBP (12.181) is, in fact, the minimum occupation time Ml{w, 0) = Ml{w, a)) — aioiwE {—L, c/r). 

To this end, first note that rh is concave on [0, thus, we can define its convex dual via the 
Legendre transform. Indeed, for w > —L, define 

(2.40) m{w) = max {rh{y) — wy) . 

y>o 

We will show that m satisfies the conditions of Theorem 12.11 and thereby show that m{w) = 
Ml{w, a) - a = Ml{w, 0) for w G (-L, c/r). 

For w G {—L,c/r), the critical value y* solves the equation rh'{y) — w = 0; thus, y* = liw), in 
which I is the inverse of m'. Note that y^ = /(O) and that y > y^ corresponds to w < 0. It follows 
that 

(2.41) m{w) = m{I{w)) — wl{w). 
Expression (]2.4ip implies that 

(2.42) m\w) = m' (/(w)) I'{w) - I{w) - wl\w) = wl\w) - I{w) - wl\w) = -/(w). 
Thus, y* = I{w) = —m'{w). Note that from (12.421) . we have 

(2.43) m"iw) = -I'iw) = ] 

It is also straightforward to show the following relationship, which we use in the next section when 
we investigate properties of Ml- 

„n X m!" (l(w)) 
2.44 w!"{w) = ^ ^ '\ . 

Theorem 2.2. Let m be given by { 2.40^ , in which m is given by Proposition \2.1\ Then, the 
minimum occupation time Ml defined in (1^.51) is related to m by ML{w,a) = m{w) + a for 
(w,a) G {-L,c/r) x R+ . 

Proof. We first find the boundary- value problem (BVP) that m solves given that rh solves (I2.18p . 
In the ODE for m in (I2.18p . let y = I{w) = —m'{w) to obtain 

(2.45) A m {I{w)) = (A - r)I{w)m' {I{w)) + 6P{w)rh" {I{w)) + cl{w) + l{„<o}- 
Rewrite this equation in terms of m to get 

(m"(w))^ 

(2.46) A {m{w) - wm'(w)) = -(A - r)m'(w)w + 6- - cm'{w) + l|^<o}, 

—m"[w) 

or equivalently, 

(2.47) A m{w) = l|^<o} + (rw - c)m'(^) - 5^-^^^-^^. 

m"[wj 
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Note that because m is convex, —5 (m"(w))^ /m"{w) can be written as 

min^r \{jJi — r)7im'{w) + |(j^7r^m"(tf)] , which is similar to the minimization term in fl2.6p . 

Next, consider the boundary and terminal conditions in f l2.18p . First, the boundary condition 
at 1/ = 0, namely m(0) = 0, and m'(0) = c/r from ( 12.25P imply that the corresponding dual value 
of w is c/r and that 

(2.48) m(c/r) = 0. 

Similarly, the boundary conditions at y = i/l, namely rh{yL) = l/X — Lyi and rh^yL) = —L, imply 
that the corresponding dual value of w is — L and that 

(2.49) m(-L) = \. 

A 



Because m satisfies the conditions given in Theorem 12.11 we have shown that the minimum 
occupation time Ml for {w, a) G {—L, c/r) x ]R+ is given by Ml{w, a) = m{w) + a. □ 

Thus, we can obtain the minimum expected occupation time Ml as described in the following 
corollary to Theorem 12. 2[ 

Corollary 2.1. For {w,a) G {~L,c/r) x ]R+, the minimum expected occupation time Ml is given 

by Ml{w, a) = m{w) + a, in which m is given by 

(2.50) 

^ f3L{^-w)\ Q<w<c/r- 



miw) 



y 



i, -L < w < 0. 



In the first expression of fl2.50p . the constant p equals Bi/{Bi — 1) > 1. In the second expression 
of fl2.50p . y is the solution of w = rh'{y), in which m' is given by (12.331) . Finally, Pl is given by 
continuity of m and m' at w = and solves 

(2.51) yo = PLP {^y~\ 

Here, yo and yL are as in Proposition \2.1[ 

3. Properties of the Minimum Occupation Time and Optimal Investment 

Strategy 

In this section, we address the following questions. 

(i) How does the optimal investment strategy vr2(w) given in (12.81) compare with the optimal 
investment strategy when m inimizing the probability of lifetime ruin, as determined in 



Bayraktar and Young! (j2007l ). namely c/rw ^ which p = Bi/{Bi — 1)? 



ct2 p-l 1 

(ii) How does t^*l{w) vary with respect to wl 

(iii) How do vr^ and Ml change as L ^ oo? 
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3.1. Optimal investment strategies. Let ttq denote the optimal investment strategy when 
minimizing the probability of lifetime ruin. Recall that this is the optimal investment strategy 
corresponding to any ruin level; that is, it is independent of the ruin level. Then, we have the 
following proposition. 



Proposition 3.1. ttHw) = tTq{w) for < w < c/r, and ttI{w) > tTq{w) for —L < w < 0. 

Proof. For < w < c/r, Corollary 12.11 gives us that m{w) = I3i{c/r — wy. Then, from the 
expression in (12.81) . we obtain that nl{w) = ^^^Z-^ = 7i"o('"^)- 
For -L < w < 0, 

fi-r m'{w) u-r c/r -w 

3-1 TT^H = 2 JiT^ > — 2 T~ 

m"[w) p — 1 

if and only if 

(3.2) -ym"{y) > {B, - l)(c/r - m'{y)), 

for HQ < y < yL, by substituting w = rh'{y) into (13.11) . By substituting for m' and m" from (12.330 
and (I2.39p . respectively, into (13.21) and simplifying the result, it becomes 

(3.3) - B2{1 - B2){y/yLf'-^ > B2{B, - l){y/yLf^-\ 

The inequality in (13.31) is true because the left-hand side is positive, while the right-hand side is 
negative. □ 

Proposition 13.11 implies that if one seeks to minimize expected occupation time, then leveraging 
is worse for negative wealth than when minimizing the probability of lifetime ruin. 

3.2. 7r2 as a function of w. When minimizing the probability of lifetime ruin, the optimal 
investment strategy is a linear, decreasing function of w. From the first part of Proposition 13. 
we know that the same is true for vr2(w) for < w < c/r. Therefore, we wish to see how '/r2(w) 
varies with respect to w for —L < w < 0. 

/ \B1-B2 

Proposition 3.2. t^i{w) decreases on (— L,0) if and only if Bi{Bi — l) ( ^] > —-82(1 — 

If r < A, then TTiiw) increases on (— L, 0). 

Proof. /^From the expression in (12.81) . we know that vr2(w) decreases with respect to w if and only 
if —m'{w)/m"{w) decreases with respect to w, or equivalently by differentiating, if and only if 

(3.4) m! {w)m!" {w) < {m"{w))^ . 

By setting w = rh'{y), or equivalently y = I{w) = —m'{w), and by using (I2.43P and (I2.44p . 
inequality (13. 4p becomes 

(3.5) ym"'{y)<-m"{y). 
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/^From fl2.39p . we obtain that for Vq < y < Vl 
(3.6) 

1 (5i-l)(l-S2) (c 



m"{y) 



vl 



Bi — B2 



+ L 



BAB, -2) 



y_ 

Vl 



Bi-3 



52(52-2) 



VlJ 



By substituting for m" and m'" from (12.391) and (13. 6p . respectively, into (13.51) and by simplifying 
the result, the inequality becomes 

B1-B2 



(3.7) 



B,(B,-1){^ 



Bod -Bo) > 0. 



The inequality in (13.71) holds for all i/o < y < if and only if it holds at y = yo, and this completes 
the proof of the first part of the proposition. 

By a similar line of reasoning, we learn that tt^{w) increases on {—L, 0) if and only if 

B1-B2 



(3.8) 



5i(5i 



y_ 

Vl 



+ Boil -Bo) < 0, 



for all yo < y < yL, which occurs if and only if (13.81) holds at y = yi. It is straightforward to show 
that Bi{Bi - 1) < -^2(1 - B2) if and only if r < A. □ 

Proposition 13.21 shows us that if the rate of return on the riskless asset is low enough, then the 
individual will borrow more money to invest in the risky asset as wealth gets closer to zero. In 
other words, because the borrowing rate is low, the individual can take on more debt (because 
debt is relatively cheap) in order to get wealth above zero. 

3.3. Varying L. In this section, we examine how Ml and vr^ change as L increases. 
Proposition 3.3. If Li < L2, then nl^{w) < irl^iw) form G (-Li,c/r). 

Proof. Because vr2(w) is independent of L for w G [0, c/r), it is enough to show that dT^^iw) /dL > 
for w G (— L,0). Showing this inequality is equivalent to showing that —-^ym"{y) > for 
y G (1/0, 1/l)- From (I2.39p . this inequality is equivalent to 



(3.9) 



dL \r 



Vl 



5.(^ 

Vl 



B2-1 



> 0, 



yo<y < Vl, 



or 



(3.10) 



+ L 



+ 



5i(fii - 1) 



Bi-2 



Vl 



Bi-l 



Vl 



B,{^ 
Vl 



32(1 -B2] 

B2-l^ 

' > 0, 



y_ 

Vl 



B2-2 



dL 



yo<y < Vl- 
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^From w = m'{y) for —L < w < 0, we compute ^^^qI^^ by differentiating with respect to L and 
obtain 



y_ 



Bi-l 



Bo 



y 



{B, - 1)B, ^ 

\yL 



y_ 

Vl 

B2-1 



B2-2 



diy/yi) 
dL 



(3.11) 

By substituting ^^^q^^ from (13. lip into the inequahty in (13.101) . we obtain the following inequality 



(3.12) 



5i(fii - 1) ( - 

yh 



+ (5i-l)(l-B2) 



Boil -Bo 



B^il-B,){y- 

yi 



B1-B2 



+ {Bi - 1)^2 



Bi 



y_ 

yi 



Bi~B2 



n 2 



Bo 



> 0, yo <y < yi, 



which after simplifying, is clearly true. 



□ 



Proposition 13.31 states that vr^ increases as L increases. That gives rise to the question as to 
how far vr^ increases? That is, what is its limiting value as L ^ 00? The next proposition answers 
that question. 

Proposition 3.4. As L ^ 00, ti*]^{w) 00 linearly with respect to L, for all w < 0. 

Proof. Fix w < 0; then, for L < w, the dual value y corresponding to w solves w = rh'{y) from 
(I2.33p . or equivalently, 



(3.13) 



c + rL B1-B2 \yL 



c-rw 5i(l-fi2) fvV''' , (5i-l)52 fy 



B2-1 



B,-B2 \yL, 

As L gets large, the left-hand side of (I3.13P goes to 0, while the solution of y/yi goes to z, which 
solves 

R1-B2 _ Bi-1 B2 



(3.14) 

independent of w. 
We also have 



Bi I-B2 



lim TTr iw) = — lim 



fi — r m [w) 



(3.15) 



^ ^ L^oo o"^ m"{w) 
oc — lim ym"{y), 

L—*oo 

y ^ ^^ ^^ 

oc lim I -Bi ( — 

L^oo \ \ y^ 



Bo 



for y = —m'{w) 

B2-l^ 



-) 

yLj 



r 
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Here, a (x b means that there exists a positive quantity k independent of L such that a = kb. It 
follows that 

(3.16) lim irliw) oc (Biz^'-^ - B2Z^'-^) lim (- + l) = oo. 

L^oo L^oo Vr / 

Unearly with respect to L. □ 

Proposition 3.5. If Li < L2, then Ml^{w,0) > Ml2{w,0) for w G {-Li, 00). 

Proof. See the Appendix. □ 

Thanks to Proposition 13.51 we can show that the sequence of function defined in (12.51) converges 
to the value function of minimizing lifetime occupation time. 

Proposition 3.6. For any w G M and a > 0, we have that 

(3.17) lim ML{w,a) = inf 

Proof. It follows from Corollary 12. II that Ml{w, a) = a + Ml{w, 0). Thanks to Proposition 13.51 we 
know that if Li < L2, then Mi^(iy,a) > ML^{w,a) for w G (— Li,cxd). However, when w < — Li 
we have that Ml-^{w, a) = Ml^{w, a), which follows directly from (12. 5p . As a result 



lim Ml^WjO) = inf ML{w,a). 

L— >oo L>0 



But then, 



lim Mi(w,a) = inf inf E""'" 

L— >00 L>0 TT 



inf inf E""'" 

TT L>0 



infE"'''^ [Ar,]. 



□ 

Proposition 13.51 gives rise to the question as to how far Ml decreases as L increases without 
bound? The next proposition answers that question. 

Proposition 3.7. For all w G M, lim^^oo ^^(tt;, 0) = inf^E"''" [A^J = 0. 

Proof. First note that from (I2.38P and the observation accompanying it, we have that the dual 
variable y — > as L ^ 00 for all w < Recall that the dual variable y = —m'{w); thus, as 
L — >■ cxD, it follows that m'{w) for all w < 0. In particular, yo 0, which implies that /3l — > 
in fl2.5ip . Thus, the conclusion of the proposition follows. □ 
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The minimum expected occupation time goes to (and trivially convex and non- decreasing on 
all of M) because the corresponding investment strategy grows linearly with L (see Proposition [33]) • 
In other words, as soon as wealth gets negative, the investment strategy becomes infinitely large 
and thereby leverages the wealth back into positive territory with probability 1. 

Remark 3.1. When the wealth is negative the individual is borrowing in order to fund her con- 
sumption. It is natural to impose a higher borrowing rate, say b > r, for individuals who have 
negative wealth. However, having a higher borrowing rate for negative wealth would not change 
qualitative results of this paper. In particular, the Legenre transform of value function rh on 
(— oo, 0) can be calculated as in l^2.26\) - (^.36\) just by replacing r with b, recalling that Bi and B2 
appearing in these expressions are also functions ofr. Now, it can be easily checked that the state- 
ments we proved in this section for the optimal investment strategy 7t{w) = —{fi — r)/a'^y7fi"{y), 
in which w = rh'{y), and the value function remain exactly the same. 

One might also try to impose a restriction on trading by setting ttj = when Wt < 0. In this 
case K^'^-lAr^] = 1/X, for w < 0, since the individual has no chance to recover from bankruptcy. 
As a result, with this restriction on trading, the problem of minimizing t he occupation time is 
eauivalent to the problem of minimizing the probability of lifetime ruin; see Wayraktar and Young 

Imni). 



4. Extension 

4.1. More General Assumptions on r^. Note that we can write (12.51) as 
(4.1) Ml{w, a) = inf E / ^ Xe'^'A^ds + e"^"^ (a^^ + ^ 



L^o 



and thanks to (12. 2p we know that M solves 

(4.2) X{Ml -a) = l|^<o} + {rw - c)M'^ + min 



1 



(/i - r)7rMi + -a'7:'M'l 



When Trf is the nth jump time of a Poisson process (i.e. has Erlang distribution) we expect that 
Ml{w, a) = M^'^\w, a) in which M(°) = a and 

1' 



(4.3) 

for G {1, 
solution of 



M^''\w,a) = infE 



n 



}. Moreover, we expect that for each m E {—L,c/r), M^^^ will be a classical 



(4.4) A(M('=) - M^™-!)) = l{^<o} + {rw - c){M^^^)' + min 



(;u - r)7r(M('=))' + V7r2(M«)" 



and that M^^\w^a) = a + m^''\w), in which m*^^-* satisfies conditions (i)-(iv) in Theorem 12.11 
In our future work, we will make these statements more rigorous and analyze the effect of of 
increasing n on the optimal investment of the retiree. 
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A generalization of Erlang distribution for would be to consider the time of absorption of a 
continuous time discrete state space Markov chain with one absorbing state. In this case Td is said 
to have a phase-type distribution, which is dense in the set of all positive-va lued distribu tions, 
that is, it can be used to approximate any positive valued distribution; see e.g. iNeuts ( 1989 ). We 
will next describe how one can solve for Ml with this assumption on r^. Let aij be the rate at 
which this Markov chain jumps from state i to state j. Then the action of infinitesimall generator 
A of this Markov chain on a test function / : {1, 2, rf} — M is given by 

(4.5) Afit) = J2^v[fij)-fi^)l ^e{l,2,...,d}. 

If we assume that there is a family of functions m^'^^w), i E {1, ■ ■ ■ ,d} solving the coupled non- 
linear ordinary differential equations 



(4.6) 



E 



aij[m 



» _ ^(i) 



4u;<0} 



+ {rw — c){m^^^y + min 



1 



(yU — r)7r(m^*^)' + -o'"t!' 



2~2(M»)" 



on w E {—L,c/r) and satisfy the conditions (i)-(iv) in Theorem 12. ![ then we can show that 
Miiw^a) = m^^'^ + a, in which k E {1,2, is the absorbing state. The verification of this 

assumption and detailed analysis of this problem will be the topic of our future work. 

In general, when P(r^ > t) = exp(— A(s)(is), for some positive function A, then Mi will 
also be a function of the current time and is expected to satisfy a non-linear partial differential 
equation 



(4.7) \{t){ML-a) 



OMl , , ,dML 

+ i-{w<o} + [rw - c)— h mm 



dMrl, ,d'ML 
[fl - r)TT— + -(T TT — 

ow 2 o-^w 



dt ' ""^"^ ' ' ' dw 

on w E {—L,c/r) and t > and satisfy the boundary conditions dictated by the conditions in 
Theorem 12.11 Legendre transform linearizes this partial differential equation at the expense of 
introducing free boundaries. This generalization will also be analyzed along with the two cases we 
mentioned above in our future work. 

Guided by the results on minimizing probability of ruin we expect that the value function 
ML{w,a,0) will not change much if the expected value of is kept the same; however the dis- 
tributional assumptions on Td is expected to have a significant impact on the optimal investment 
strategy (see Figure 6.3 of iMilevsky et al.l (120061 )). However, approximate investment strategies 
based on the one we obtained in this paper might give nearly optimal strategies: An investor 
might estimate her (constant) hazard rate A each year and rebalance her portfolio using vr* we 
prescribed in this paper. Then she waits without taking any further action until the next year 
and rebalances her portfolio given her new estimate for the hazard rate. In the problem of mini- 
mizing pro bability of ruin this discre te rebalancing approximation scheme was shown to be nearly 
optimal by iMoore and Youna (120061 ). A similar analysis needs to be undertaken for the problem 
of minimizing the occupation time. 
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4.2. Minimizing the Expected Area Below Zero. A natural extension to the problem of 
minimizing expected occupation time is to replace A in the definition of Ml in (12.51) with A'^ 
defined by 

(4.8) A{ = Al+ [ f{Ws) ds, 4 = > 0, 

Jo 

in which / is some non-decreasing function of wealth, and to replace the penalty 1/A in (12. 5p with 
f{—L)/\. Specifically, the value function is defined by 

(4.9) M/(w;,a-^) = infE""'' 

In (12.51) . the function / is given by f{w) = I^^^q^. For another example, if the goal were to 
minimize the expected area between the negative part of the trajectory of wealth and the w = 
horizontal line, then / would be given by f{w) = —w l{w<o}- 

As in Theorem 12. we expect that M[ to be given by M[{w,a^) = [w) + a-^, in which ra^ 
satisfies the conditions listed in that theorem with appropriate changes. Specifically, m^{w) = 
f{—L)/X for all w < —L and solves the following HJB equation on {—L,c/r): 

(4.10) Xm^{w) = f{w) + {rw — c){vrJ)'{w) + min 

Now, in order that the corresponding FBP be linear as in Section 12. 3[ the function / must be 
piecewise linear. Moreover, to be able to get closed-form solutions for the solutions of the ODEs 
in the FBP, / must be piecewise constant. By approximating a given function via a step function, 
one can approximate the value function M^. 



Al 1 



Td 



(/i - r)7T{m^y{w) + -a^7c'^{m^)"{w) 



A. Appendix: Proof of Proposition 13.51 



From the relationship between Pl and i/q in Corollary 12. ![ we see that it is enough to show that 
dMiiw, 0)/dL < for w G (-L, 0). To that end, recall that 



(A.l) ML{w,0) = yi--w 

\r 



B1-B2 \r 



Bi-l (c 



Vl 



y 



B2 



in which w = rh'{y), or equivalently. 



(A2) 



— w 



+ L 



Bi — B2 



y_ 

Vl 



Bi-l 



+ 



(5i - 1)^2 / y 



B1-B2 \yL 



B2-1 
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aMi(w,o) 

dl 



w 



dy_ 
dL 



I-B2 2/^1 , Bi-1 y 



B2 



BA1-B2 



+ 



Bi — B2 

(5i-l)(l-52 



{B, - 1)B2 (y\ 



Bi — B2 



c ^\ dy 
r 



dL 



y_ 



Bi 



{B,-l)il-B2] 
Bi — B2 



y_ 

Vl 



B2 



wliicli simplifies to tlie following after substituting for c/r — w from (lA.2p : 
dML{w,0) 



+ L 



dyi 



dL 



(A.4) 



I-B2 Bi-1 
Bi - B2 yf^-^ 5i - B2 y^--' 

' y_ 

Vl 



+ [- + L 



Vl 

{B,-l){l-B2] 



Bi — B2 

which is negative for y^ < y < ii and only if 



y_ 

Vl 



B2 



dyi 
dL 



{^^L)iB.-m-B2) (^)"-( 



(A.5) 



- Vl 



Vl 



y_ 

y 



Vl 



B2 



B2 



dyL 
dL 

< 0. 



To prove the inequality in (lA.Sp . we require an expression for dyi/dL. To that end, note from 
flCTl) . it follows that 

. (yoV'~' _ B,-B2 B,{l-B2) fy.V'-' 

^ • ^ UJ c/r + L (Si - 1)B2 {B, - l)B2 W) 

^From fl2.34p . after differentiating with respect to L and simplifying, we also obtain 



c/r 



1 



dL {c/r + LY 1~B2 B,iyo/yL)^^-' ~ 

Next, from f l2.36p and from ( 1A.6I) . it follows that 

'b,-B2 c l-B2fc 



c/r 



c/r+L 



(A.8) 



1 



A 



+ L 



m 

Vl 



B1B2 r B2 
After differentiating with respect to L and simplifying, we obtain 



(A.9) 



Idyo A fy,Y^-'B,il-B2)iyo/yLr^-'-iB^-B2)^ 



yl dL B2 \yL 



B,{yo/yLr^-' 



c/r 
c/r+L 
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1 dyo d{yo/yL)/dL 
Vl- 



dL yo/yL dL yo/yi 



(A.IO) 



VoVl 



+ yL 



A / 1/0 



B2 \yL 

c/r 



c/r+L 



Bi{yo/yL) 
Vo/Vl 



Bi-l 



c/r+L 



Substitute for {yo/yL}^^^^ from flA.81) into this expression and simplify to obtain 



(A.ll 



dyi 



-1 



B2{c/r) 



dL c/r + L 

Then, from ([Qj) and flATTj) . dML{w, 0)/dL < if and only if 

Bi / ^ _ \ B2 



(A.12) 



(5i-l)(l-52) 



'1-B. 



y_ 

Vl 



y_ 

Vl 

B 



y_ 

Vl 



{B, - I] 



iB,-l)ic/r)-B,B,/iXyo) 

52 (c/r) 



-1 + 



iB,-l)ic/r)-B,B2/iXyo), 



y_ 

Vl 



B2 



< 0, 



yo<y < Vl- 



It is straightforward to show that the left-hand side of (1A.12P is decreasing with respect to y; 
therefore, it is enough to prove (]A.12p for y = y^. By substituting for {yo/yL)^^~^ and (i/o/i/l)'^^~^ 
in terms of yo, and simplifying the result, we obtain the following inequality: 

/ . N B^ — Bo C Bo 

A.13 _^^_ + ^<0, 

Bi r Xyo 

which is clearly true. Thus, we have shown that M/, decreases as L increases. □ 



Acknowledgements. We thank Mario Boudalha-Ghossoub for suggesting this problem. We 
also would like to thank the other participants of the Department of Statistics Seminar at the 
University of Michigan and the two anonymous referees for their comments which helped us 
improve our paper. 

References 

Akahori, J. (1995). Some formulae for a new type of path-dependent option. Annals of Applied 
Probability 5: 91-99. 

Bayraktar, E. and Young, V. R. (2007). Correspondence between lifetime minimum wealth and 

utility of consumption. Finance and Stochastics 11 (2): 213-236. 
Bremaud, P. (1981). Point Processes and Queues, Springer- Verlag, Berlin. 



OPTIMAL INVESTMENT STRATEGY TO MINIMIZE OCCUPATION TIME 



21 



Doney, R. A. and Yor, M. (1998). On a formula of Takacs for Brownian motion with drift, Journal 

of Applied Probability 35: 272-280. 

Hugonnier, J. (1999). The Fcynman-Kac formula and pricing occupation time derivatives, Inter- 
national Journal of Theoretical and Applied Finance 2: 153-178. 

Karatzas, 1. and Shreve, S. E. (1991). Brownian Motion and Stochastic Calculus, Springer- Verlag, 
New York. 

Karatzas, I. and Shreve, S. E. (1998). Methods of Mathematical Finance, Springer- Verlag, New 
York. 

Linetsky, V. (1999). Step options. Mathematical Finance 9: 55-96. 

Milevsky, M. A., Moore, K. S. and Young, V. R. (2006). Asset allocation and annuity-purchase 
strategies to minimize the probability of financial ruin. Mathematical Finance 16(4): 647-671. 

Moore, K. S. and Young, V. R. (2006). Optimal and simple, nearly optimal rules for minimizing the 
probability of financial ruin in retirement. North American Actuarial Journal 10(4): 145-161. 

Ncuts, M. F. (1989). Structured Stochastic Matrices of M/G/1 Type and Their Applications, 

Marcel Dckkcr, New York. 
Pechtl, A. (1999). Distribution of occupation times of Brownian motion with drift. Journal of 

Applied Mathematics and Decision Sciences 3: 41-62. 
Takacs, L. (1996). On a generalization of the arc-sine law. Annals of Applied Probability 6: 1035- 

1040. 

(Erhan Bayraktar) Department of Mathematics, University of Michigan, Ann Arbor, MI 48109 
E-mail address: erhan@uinich.edu 

(Virginia R. Young) Department of Mathematics, University of Michigan, Ann Arbor, MI 48109 
E-mail address: vryoung@uinich.edu 



